# 70B large model quantization

This is a quantized version of the Austral-70B-Winton model by Delta-Vector. Through quantization technology, it reduces the storage and computational resource requirements of the model while maintaining good performance, making it suitable for scenarios with limited resources.

This is a quantized version of a large language model with 70B parameters, offering multiple quantization levels to meet different hardware requirements